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AESTRACT 

General objectives were to develop and implement 
compute r-uased procedures for obtaining validated data on the 
characteristics of vocational school students and to convert this 
data into counseling information. Two types of data-ini ormaticn 
conversion procedures were field-tested: similarity scores based on 
discriminant analysis, and success estimates based on regression 
analysis. Scores from 3t aptitude, interest, and personality measures 
were accumulated for approximately 1600 prospective area vocational 
school students. A progress record was kept ror each of these 
students after vocational school enrollment. Multivariate analyses 
conducted on antecedent and criterion data formed the bases for 
data-informaticn conversion procedures used in the field tests. It is 
concluded that: (1) Successful and satisfied students enrolled in 

diverse vocational programs can be di tier entiated by aptitude, 
interest, or personality measures obtained prior to or shortly after 
entry into the programs; (2) Similarity scores and profiles represent 
effective tehcniques for translating data on these differences into 
useful counseling information; (3) usetul estimates of vocational 
pregram sue cess can be conveyed to students in the term of experience 
tahles based on the best predictors in a comprehensive battery of 
aptitude measures; and (4) The development of a generalized system of 
computer-based procedures for da fa-information conversion is both 
feasible and desirable. (Author/ EE) 
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The general objective of this project was to develop and implement 
computer-based procedures for obtaining validated data on tne charac- 
teristics of vocational school students and to convert this data into 
information that could be used by counselors in helping students select 
an appropriate vocational education program. The rationale for the pro- 
cedures used to convert test data into counseling information has been 
presented by Prediger (1970, in press) and can be summarized in the 
following eight points: 

1. Information from tests, when viewed in the context of decision 
theory, can play an important role in vocational development. 

2. This role is primarily one of stimulating and facilitating 
exploratory behavior. 

3. Two data-inf orrnation conversion procedures — similarity (centour) 
scores and success estimates — are crucial to this role. 

4. On the basis of both logical and technical considerations, 
similarity scores are more appropriate than success estimates in stimu- 
lating and facilitating exploratory behavior. Success estimates represent 
one of many things to be considered in the process of exploration. 

5. Similarity scores eliminate much of the guesswork inherent in 
test profile interpretation. 

6. Graphical procedures are available to provide help in under- 
standing the reasons underlying a given counselee's similarity scores, 
thus avoiding the t:ake-it-or-leave-i t aspects of test interpretation 
based on similarity scores alone. 

7. These procedures can also facilitate use of test data to initiate 
changes in counselee characteristics and/or the characteristics of groups 
representing various choice options, rather than merely to represent the 
status quo. 

8. Data-information conversion procedures must rely heavily on the 
availability of local validity data. 



x This project was partially supported by a contract with the Office of 
Education, U.S. Department of Health, Education, and Welfare. 

Several of the appendices noted in the paper have not been attached 
in order to conserve space. Copies of these appendices are presented in 
the USOE research report by Prediger (1970) cited in the reference list. 
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A prototype package of computer programs was developed to facilitate 
data-information conversion. In the approach that was used, heavy 
reliance was placed on the multivariate research and classification 
strategies represented by the work of Cooley and Lohnes (1962, 1968) 
and the decision-oriented paradigm for local guidance research proposed 
by Clarke, Gelatt, and Levine (1965). On the basis of research results 
and the experience gained through the use of the prototype system, spec- 
ifications were developed for a generalized "Test Validation and Infor- 
mation Feedback System" (TVIFS) that would be applicable to divergent 
educational settings and a variety of data-information conversion needs. 
Support for the development of early phases of TVIB ? S was obtained from 
the Ohio Board of Regents. With the exception of the follow-up component, 
TVIFS is scheduled to become operational in 1971. An overview of TVIFS 
is attached at the end of this report. 

Project activities were conducted in an area vocational high school 
drawing students from 14 feeder schools. Several considerations made 
this an ideal seti Lng in which to develop and implement data-information 
conversion procedures. For example, vocational programs are little known 
and often misunderstood by students, parents, and counselors. Nevertheless, 
students in the feeder schools must decide sometime during their sophomore 
or junior year whether they want to attend the area vocational school, and 
if so, which of some 25 vocational education programs they wish to enter. 
Informed choice is crucial since the vocational school attempts to honor 
the requests of its applicants instead of applying arbitrary placement 
procedures. Because of the concentrated amount of time spent in the 
programs (six out of eight periods a day), the choice a student makes 
may have a substantial effect on his vocational development. Student 
program choices are also of interest to vocational instructors and super- 
visors since the success of their programs depends on having students 
with the requisite abilities, interests, and motivation. In this context, 
data-information conversion procedures that call to a student f s attention 
the vocational education programs for which he appears to have the requisite 
characteristics, can play an important role in improving the quality of 
enrollees in the various programs. At the same time, the student's freedom 
of choice is preserved, and the process of choice is facilitated. 

Data-information conversion procedures require the presence of certain 
relationships between the antecedent and outcome variables. There is 
ample evidence that these relationships exist in vocational-technical 
school settings. Patterson (195 6); Prediger, Waple, and Nusbauin, ( 1968 )^ 
and Stock and Pratzner ( 1969 ) have reviewed studies in which the corre- 
lation between antecedent variables and success criteria was determined. 

In general, these reviews have shown that (a) success in vocational 
education programs (usually measured by grades) is predictable to an 
extent that has practical significance; (b) the level of predictability 
depends on the vocational area and the predictors that are used; and 
(c) the results of studies vary widely from one setting to another. 

These findings support the feasibility and desirability of developing 
success estimates based on local validity data. 
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Research in which multivariate procedures were used to study voca- 
tional program differences is finally beginning to accumulate. D’ Costa 
(1968), Doerr and Ferguson (1968), Passmore (1968), Pucel (1969), Silver 
(1967), and Stewart (1966, 1968) have shown that students enrolled in 
various vocational programs can be differentiated to a statistically 
significant extent by aptitude, interest, and personality variables used 
alone or in various combinations. In all but Pucel’s study, multiple 
discriminant analysis procedures were employed to determine the way in 
which the groups were differentiated. Without exception, the first two 
discriminant factors accounted for most (typically more than 80%) of 
the discriminating power of the variables. Since the nature of the pre- 
dictor variables and criterion groups varied from study to study, general 
conclusions as to the composition of the discriminating factors or the 
manner in which the groups differed are not possible. Comparison and 
generalization across studies will continue to be difficult until some 
agreement is reached on bench-mark variables and criterion groups. 

Passmore (1968) has shown that even when the same variables and groups 
are involved, validity generalization cannot be assumed. 

In several studies, the accuracy of program membership predictions 
based on a student’s similarity scores was determined. The level of 
accuracy achieved from study to study varied with the nature of the 
variables, the number of vocational programs involved, and the statistical 
procedures used in obtaining the predictions. Only Silver ( 1967 ) concluded 
that accuracy of the predictions did not warrant guidance applications. 

Use of similarity scores in counseling was suggested in several of the 
studies . 

Longitudinal validation procedures were employed in only two of the 
seven studies cited above (Pucel, 1969; Silver, 1967 ). Thus, most of the 
evidence that vocational programs can be differentiated is based on pre- 
dictor and criterion data collected concurrently . No one has reported 
the actual use of analysis results in an ongoing guidance program. In the 
present study, the results of longitudinal analyses provided the basis 
for converting data on students into information that was used by counselors 
in 12 field-test schools. Student and counselor reactions to this experi- 
ence are reported. 

As noted above, previous research has shown that the relationships 
between antecedent and outcome variables required for data- information 
conversion are likely to vary from one vocational education setting to 
another. Hence, the nature of these relationships must be determined 
for the setting in which data- information conversion procedures are to 
be used. For this reason, answers to the following questions were sought 
during the course of the project. 

Similarity scores 

1. What procedures are appropriate for identifying and grouping 
similar vocational programs when the objective is to facilitate data- 
information conversion? 
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2. Is it possible to differentiate successful and satisfied students 
enrolled in these programs through use of comprehensive batteries of 
aptitude, interest, or personality measures obtained prior to or shortly 
after entry into the programs? If so, 

3. Which variables are most effective, and what is the nature of the 
group differentiation that is achieved? 



Success estimates 



k . Within each of the vocational program areas, considered separately, 
which of the aptitude measures has the highest correlation with success? 

5- Are guidance applications of the best two-variable combination of 
predictors warranted on the basis of the level of correlation achieved and 
the contribution made by each predictor? 

Although the answers to the above questions are specific to the setting 
in which the study was conducted, the techniques are directly transferable 
to other settings. For example, the same questions could be asked of data 
obtained from students prior to entry into various college majors or occu- 
pational. clusters . 
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Procedures 



Subjects 



The students in this study were enrolled at the Penta-County 
Vocational School, a vocational high school serving a five-county area 
surrounding Toledo, Ohio. When the project was begun early in 2.966, 

17 high schools sent students to Penta-County. As a result of consolida- 
tions, there were only 14 feeder high schools four years later. Enrollment 
in these schools varies from about 100 to 1,000 students with a median of 
about 500. The school districts range in socio-economic level and tax 
evaluation from low to above average and cover a composite of rural, 
small town, and urban areas, but not the center-city itself. 

Penta-County operates approximately 24 different high-school— level 
vocational programs. (The number varies from year to year.) Most students 
enter as juniors; however, there are a few one-year programs open to 
seniors. The school has diligently tried to maintain an open-door policy 
that admits a student to the progi'am of his choice. In cases where a 
large number of students apply for a program with limited space, this is 
sometimes impossible. However, every effort is then made to place the 
student in his second-choice program. Ramsey (1966) has presented a 
detailed description of the school, including the technical college with 
which it shares facilities. 

Students entering Penta-County as juniors or seniors in the fall of 
1966, 1967, and 1968 formed the sample used in the analyses. Since there 
is some shifting in and out of programs during the first month of school, 
sample membership was not determined until the end of September. The 
total sample consisted of 1.584 students, or approximately 500 students 
per year. 

Variables 



Scores from the following tests and inventories wei’e used as ante- 
cedent variables: 

1. General Aptitude Test Battery, Form B-1002, (GATE): Verbal 

Aptitude (V), Numerical Aptitude (N), Spatial Aptitude (S), Form 
Perception (p), Clerical Perception (Q), Motor Coordination (K), 

Finger Dexterity (F), and Manual Dexterity (M). 

2. Differential Aptitude Tests, Form A, (DAT): Mechanical Reasoning 

subtest (MR). 

3- Ruder Preference Record--Vocational, Form C, (Kuder) covering the 
following interest areas: outdoor (0-l), mechanical (M-l), computational 

(C-l), scientific (S-l), persuasive (P-l), artistic (A-l), literary (L-l), 
musical (MU-I), social service (SS-l), and clerical (CL-l), 

4. Lorge-Thorndike intelligence Tests, Form A: Verbal IQ, (VIQ) 

and Nonverbal IQ (NVIQ). 
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5. Junior-Senior High School Personality Questionnaire, 1963 Edition, 
Form A, (HSPQ) covering the following personality dimensions: warmhearted 

(A-P), bright (B-P), emotionally stable (C-P), excitable (D-P). assertive 
(E~P), enthusiastic (F-P), conscientious (G-P), adventurous (H-P), tender- 
minded (I-P), reflective ( J-p), apprehensive (o-P), self-sufficient (Q2-P), 
controlled (Q3-P) ? and tense (Q4-p). 

Only the descriptive labels associated with high scores on the HSPQ 
are given for the above dimensions . Abbreviations for the HSPQ scales 
are identical to those appearing in the latest test manual (Cattell & 

Cattell, 1969 )* Since several Kuder and HSPQ scales are subject to rather 
substantial sex differences, normalized standard scores based on percentile ranks 
were used in the analyses . Students having verification scores of less 
than 33 were not included in the analyses of Kuder results . Range checks 
were made on the scores from all measures. 

One additional antecedent variable, student GPA prior to entering 
Penta-County (PRE-GPA), was also available. Typically, information on 
students entering Penta-County as juniors included feeder school grades 
received during the freshman year and the first semester of the sophomore 
year. Grades for an additional year were available for students entering 
Penta-County as seniors. 

There were 36 antecedent variables, altogether, with aptitude 
represented by 12 measures (8 GATE scores, MR, VI Q, NVTQ, and PRE-GPA), 
interests represented by the 10 Kuder measures, and personality charac- 
teristics represented by the l4 HSPQ dimensions. Except for the Lorge- 
Thorndike VIQ and the HSPQ, which were administered shortly after 
students entered Penta-County, the tests were generally given during the 
fall of the year preceding a student’s entrance. The actual time of 
testing was left to the discretion of feeder school counselors. In all 
cases, testing was completed by midwinter/' Several schools elected to 
give the tests in the spring of the year preceding a student’s application 
to Penta-County. This would be slightly less than a year and one-half 
before entrance. Make-up testing involving approximately 15$ of the 
sample was completed in the fall following entrance. 

Design 



In order to make the analyses, reports of results, and the interpre- 
tation of these reports more manageable, an answer to Research Question 1 
was required; that is, a practical procedure for grouping the 24 vocational 
programs had to be found. Empirical procedures were considered, especially 
the Mahalanobis’ technique (Rao, 1952); however, use of the results of 
the analyses in a counseling setting made a logical grouping seem more 
appropriate. The basic rationale was to obtain groups having face validity 
and utility for counselors and students rather than to maximize vocational 
program discrimina ‘on. 

The Penta-County counseling staff and vocational supervisors parti- 
cipated in the initial grouping of the 24 vocational programs. Similarities 
in program content and student characteristics thought to be required in 
the programs served as the subjective criteria. The initial grouping was 
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used in preliminary discriminant analyses run on data available for 19 66 
and 1967 entrants. Slight revisions were made on the basis of group 
distribution in discriminant space and counselor reaction to similarity 
scores provided for a 1968-69 field-test sample. The revised grouping 
was subjected to a second discriminant analysis when data for the total 
sample became available. Additional counselor reaction, group size 
considerations, and the results of these analyses were used to arrive 
at the final grouping shown in Table 1. 

Seven of the 12 groups are the same as they were in the initial 
grouping. Changes usually involved shifting a program from one group to 
another. For example, machine trades and welding switched places, and 
high skill steno became a separate area, having been initially combined 
with the cooperative office education and office machine programs . 

The regression analyses required to answer Research Questions 4 and 5 
Were run separately for each of the 12 groups. However, answers to Research 
Questions 2 and 3 required that analyses be conducted across the various 
vocational programs. If the analyses were performed on all 12 groups 
simultaneously, sex differences from program to program would likely 
cloud information on program differences available in the antecedent 
variables. For example, one might find that programs enrolling girls can 
be differentiated from those enrolling boys on the basis of interests, 
aptitudes, and personality measures. This would be of little practical 
value, however, since there are better ways to tell girls from boys. Use 
of the results of the analyses for data- information conversion would also 
be limited since it makes little sense to report a girl's similarity to 
auto mechanics students or to report a boy's similarity to students in 
the high skill steno program. Such reports would most likely be meaning- 
less from a statistical as well as a practical standpoint. 

In order to avoid the problem noted above and at the same time 
provide for comprehensive analyses, the vocational programs were organized 
into three sex-related groups: programs enrolling primarily males, 

programs enrolling primarily females, and programs having a substantial 
enrollment of both males and females. As shown in Table 1, the male, 
female, and mixed groups each included four programs when the final 
analyses were performed. Separate analyses were run on the male and 
mixed groups combined (the M-MF analysis group) and the female and mixed 
groups combined (the F-MF analysis group). Thus, the M-MF and F-MF 
analysis groups each included eight vocational program groups. Similarity 
score reports were also based on this grouping. 

Multivariate analyses of variance and discriminant analyses were used 
to study the differentiation of students enrolled in the vocational programs. 
These analyses were first run separately on each of the three types of 
antecedent variables. Ten of the most effective variables identified in 
these analyses were then combined in the final analysis on which the 
similarity score equations were based. 

The vocational programs used in the discriminant analyses did not 
include students who dropped out of school or returned to the feeder high 
school, who expressed dissatisfaction with program choice, or who failed 
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Table 1 



Final Grouping of Vocational Program Areas 



Vocational area 


Original 

sample 


Discriminant analyses a 


Regression 

analyses 


Eligible Data 


available 


Programs primarily < 


enrolling males 






A, Carpentry 


57 


48 


4i 


52 


B. Auto & Ag. Mech., 


242 


163 


139 


225 


machine trades 










C. Radio & TV repair, 


88 


58 


54 


82 


electronics 










D. Auto body, welding 


116 


88 


73 


108 


Total 


503 


357 


307 


467 


Prograins en 


rolling both 


males and females 






E. Horticulture 


50 


29 


24 


4i 


F. Distributive Educ . 


103 


51 


38 


79 


G. Commercial art, 


204 


150 


134 


185 


printing, drafting 










H. Data processing, 


126 


93 


86 


113 


account clerk 










Total 


483 


323 


282 


4i8 


Programs 


primarily enrolling females 






I, Child care, Comm. Sc 


162 


95 


87 


128 


home Serv., dietary aid 










J. Cosmetology, dental Asst. 199 


151 


132 


171 


K. Co-op. office Educ., 


154 


ll6 


102 


124 


office machines 










L. High skill steno 


83 


66 


6l 


61 


Total 


598 


428 


382 


484 


Total sample 


1584 


1108 


971 


1369 


M-MF analysis group 


986 


680 


589 


885 


F-M analysis group 


I 08 l 


751 


664 


902 



a Sample sizes shown here are for the final analyses conducted on aptitude 
and interest measure s* combined . Sample sizes for the separate analyses per- 
formed on the aptitude, interest, and personality variables are given in 
Table 2. 
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to achieve a satisfactory GPA in their vocational course work. Tljie cut-off 
point for a satisfactory GPA was 1.8 or better with a M C M being 2 t 0 on a 
4.0 scale. Academic course work was not included in calculating la 
student’s GPA. I; 

/> 

A survey of student satisfaction with program choice was tal|en at 
the end of the 1968-69 school year. Hence, results were available for 
juniors entering Fenta-County in 1967 and juniors and seniors entering 
in 1968. Unfortunately , a post high school follow-up of i960 entrants 
and the small group of seniors entering Penta-County in 1967 was 1; not 
completed in time to include their satisfaction ratings in the definition 
of the criterion groups. Satisfaction ratings were available fop about 
two thirds of the sample, however. f 

The ratings were obtained on a four-choice scale administered under 
conditions conducive to confidentiality of response. Students indicating 
that other vocational programs would definitely have. 'been more ^appropriate 
to their abilities and interests or who expressed a more intense degree 
of dissatisfaction with the program in which they were enrolled? were not 
included in the criterion groups. About 12 $ of the students wluo were 
surveyed were excluded for this reason. / 

I 

The number of students available in each of the program groups after 
application of the success and satisfaction criteria is shown jin the 
column labeled "eligible” in Table 1 . Despite extensive make-up testing, 
not all of these students had a complete set of scores. The f r data 
available” column of Table 1 shows the number of eligible students who 
had scores on the ten aptitude and interest measures used in |the final 
discriminant analyses. 1? 

ji 

Students involved in the regression analyses did not ha^e to meet 
the criteria of eligibility applied to the discriminant analysis groups. 
Vocational program GPA at time of graduation or drop-out wasjj used as the 
criterion of success. Hence, only students who left school jbefore they 
had established a grade record or who had missing test scorqjs were excluded 
from the regression analyses. The number of students in the" regression 
analyses groups is shown in Table 1, j 
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Results and Conclusions 



Conclusions reached with respect to the project objectives and 
research questions are stated in the context of the results supporting 
these conclusions. Because of the importance assumed by the data- 
information conversion procedures as the project progressed, these pro- 
cedures and the field tests of them are given special attention in this 
section. 

Modified versions of the Cooley- Lohnes computer programs (Cooley & 
Lohties, 1962) were used for the multivariate analyses of variance and 
discriminant analyses required to answer Research Questions 2 and 3 • 

These programs include Box's F test for homogeneity of group dispersions, 
Wilk's lambda test for overall group differentiation, and Rao’s chi square 
test for group differentiation by a single discriminant function or factor 

The significance levels indicated by the statistical analyses were 
used in assessing the role that chance might have played in producing 
the observed results. Interest was primarily in data reduction and 
information feedback rather than the discovery of general lavrs of nature. 
Decisions with respect to data-information conversion strategies were 
based, in part, on the results of the significance tests and, in part, 
on other information produced by the statistical analyses. 

Question 1 

Workable procedures for identifying and grouping similar vocational 
programs were described in the design section of this report. Essentially 
these procedures rely on the pooled judgment of counselors and vocational 
supervisors acquainted with the nature of the programs and students to be 
grouped. Major. consideration is given to forming program clusters that 
will be helpful to students who are considering vocational program choice 
options. Empirical data on the characteristics of group members are used, 
along with counselor reactions based on field tests, to make adjustments 
in original group composition. Few adjustments were found to be necessary 
in the setting in which these procedures were implemented. Counselors 
expressed no dissatisfaction with the vocational program grouping used 
during the 1969-70 field tests. Hence, it may be concluded that the 
procedures are appropriate for identifying and grouping similar vocational 
programs when the objective is to facilitate data-information conversion. 

Question 2 



Eight vocational program groups were involved in the personality 
measure analyses. Nine groups were involved in the separate aptitude 
and interest measure analyses in order to obtain empirical information 
for use in grouping similar vocational programs. Group labels and sample 
sizes are shown in Table 2 . 

The F values obtained from Box's test for homogeneity of dispersions 
were uniformly small across all analyses. The median value was 1.11 with 
the range being 1.01 to l.l8. The size of these F values would not appear 
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Table 2 



Vocational Program Areas Used in Separate Analyses of 



Aptitude. Interest, and Personality Measures 



Vocational area Aptitude 


Sample size 
Interest 


a 

Personality 


Programs primarily enrolling males 




A. Carpentry' 


42 


4l 


45 


Bl. Auto & Ag. mechanics 


li4 


104 


16 i b 


B2. Machine trades 


37 


36 




(?• Radio & TV repair, electronics 


52 


56 


55 


13. Auto body, welding 


81 


75 


77 


Total 


326 


312 


338 


Programs enrolling both males and 


females 




E. Horticulture 


24 


24 


26 


F. Distributive Educ . 


31 


39 


44 


G. Commercial art, printing, drafting 


135 


137 


l46 


H. Data processing, account clerk • 


8 o 


89 


90 


Total 


270 


289 


306 


Programs primarily enrolling females 




11. Child care 


36 


4l 


9l c 


12. Community & home serv., dietary aid 


46 


47 ! 




J. Cosmetology, denta.l assistant 


133 


136 


130 


K. Co-op. office Educ., office machines 


79 ' 


107 


97 


L. High skill steno 


49 


62 


53 


Total 


343 


393 


371 


Total sample 


939 


994 


1015 


M-MF analysis group 


596 


601 


644 


F-MF analysis group 


613 


682 


677 



a Includes only those students meeting the success and satistaction 
criteria and who had data available. 



^Areas B1 and B2 were combined in the 115 FQ analyses. 
c Areas II and 12 were combined in the HSPQ analyses. 
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to invalidate Wilks’ lambda test for group differentiation. As noted by 
Cooley and Lohnes ( 1962 ), Wilks’ test is relatively insensitive to slight 
departures from homogeneity of dispersion. 

Results from Wilks’ lambda test are presented in Table 3* All F 
values obtained via the multivariate analyses of variance are statis- 
tically significant at far beyond z he .01 level. Thus, in answer tc 
Research Question 2, vocational program differentiation is possible through 
use of aptitude, interest, or personality measures. 

Perspective on the relative effectiveness of the different types of 
measures can be obtained by comparing the F values. For example, the 
interest measures appear to be somewhat more effective than the aptitude 
measures in the M-MF analysis group, but about equally effective in the 
F-MF group. The personality measures were, by far, the least effective 
of the three types. Since the number of groups used in the analyses 
differed, a strict comparison of F values obtained with the personality 
measures as versus the aptitude and interest measures is not warranted. 
However, multivariate analyses of variance involving 9 °f the 12 aptitude 
measures across the same 8 groups used with the personality measures 
resulted in F values of A . 34 and 7.43 for the M-MF and F-MF analysis 
groups, respectively* Both of these values are much larger than those 
obtained through use of the personality measures. 

Because of their relatively poor showing in the separate analyses, 
the personality measures were eliminated from the final analyses. Only 
the most effective aptitude and interest measures, as judged on the basis 
of separate discriminant analyses, were included. Multivariate analyses 
of variance involving ten of these aptitude and interest measures in 
combination, resulted in F values of 9*10 and 11 . 83 for the M-MF and F-MF 
analysis groups, respectively. Since these values are much larger than 
those obtained for the aptitude and interest measures separately, it would 
appear that use of both types of measures, in conjunction, results in 
substantially more group differentiation than use of either, alone. A 
cross-validation sample is needed to provide conclusive evidence on this 
point, however. 

Question 3 

\ 

As already noted, discriminant analyses were performed in conjunction 
with each of the analyses discussed above. The statistical significance 
and relative effectiveness of the discriminant factors obtained in the 
discriminant analyses are reported in Table 4. The first two factors 
achieved significance at far beyond the .01 level. The significance tests 
for the aptitude and interest measures combined must be discounted, 
however, because a cross-validation sample was not used. Nevertheless, 
the size of the chi square values provides substantial evidence that the 
vocational program groups can be differentiated on a number of dimensions. 
The interest measures appeared to be particularly effective in this respect. 

By noting the size of the chi square values obtained in the signifi- 
cance tests for a given set of predictors, it is possible to gain perspec- 
tive on the relative effectiveness of the factors. Inspection of these 
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Table 3 

Results of Wilks* Lambda Test 



for Group Differentiation 











Analysis 


group 




Type of 
measure 


No. of 
groups 


No. of 
variables 


M- 


-MF 


F- 


-MF 


F 


d.f . 


F 


d.f. 


Aptitude 


9 


12 


3.86 


96&3890 


6.14 


96&4005 


Interest 


9 


10 


5.98 


80&3706 


6.28 


80&4220 


Personality 

characteristics 


8 


14 


1.77 


98&39^9 


\ 

2.07 


98&4158 



Note, — An F value of 1.44 is needed for significance at the .01 level 
for 75 and 1000 degrees of freedom. 
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Table 4 

Chi Squares Indicating Relative Differentiation 
. of Groups by Discriminant Factors 



Type of measure 

Aptitude & 

Aptitude Interest Personality interest 



Factor 


M-MF 


F-MF 


M-MF 


F-MF 


M-MF 


F-MF 


M-MF 


F-MF 


i 


191 . 5 *** 


255 . 6 *** 


154 . 7 *** 


200.7*"** 


75 • 8*** 


83 . 7 *** 


257 . 0 *** 


346.8*** 


2 


98.3*** 


192 . 4 *** 


132 . 0 *** 


122 . 5*** 


0 r* 

35o 


43 . 8 *** 


147.6*** 


231.6*** 


3 


23.7 


44 . 9 *** 


95 . 3 *** 


56 . 6 *** 


22.0 


25.4 


99 . 3 *** 


74.3*** 


4 


19.7 


26 . 9 * 


36 . 8 *** 


54.4*** 


17.2 


18.6 


49 . 7 *** 


5 2. I*"**' 


5 


12.8 


15.3 


20 . 8 * 


28.8*** 


11.6 


17.5 


22.9** 


35«3 


6 


8.9 


12.2 


13.2 


10.7 


6.5 


8.8 


10.4 


13.2* 


7 


2.1 


6.8 


1.7 


4.9 


3.4 


2.7 


3.0 


3.2 


8 a 


1.7 


3.2 


1.2 


l.l 











a Since only eight groups were involved in the analyses for the personality 
variables and the aptitude and interest measures combined, seven factors 
exhausted the discriminating power of the measures. 



***p <.001 , **p < .01 , *p <.05 
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values shows that a large majority of the discriminating power of the 
measures was generally concentrated in the first two factors . Attention 
is focused on the first two factors in the results presented below. 

Tables 5 through 8 show the correlation of the first two factors with 
the variables used in each of the analyses. The same information for 
Factors 3 and 4 is presented in Tables 11 through l4 in Appendix D . 
Vocational program means on the first four factors are presented in 
Tables 15 through l8 of the same appendix. The ten measures selected 
for the combined aptitude-interest analyses are listed in Table 8. Sample 
sizes appeared to be too small to warrant use of all 22 aptitude and 
interest measures in the final analyses. Unfortunately, specific guidelines 
have not yet appeared on the minimum number of cases per variable per group 
required for discriminant analysis. 

The nature of the factors that best serve to differentiate students 
in the various vocational programs and the manner in which these programs 
are differentiated can best be seen from the similarity score profiles 
presented as Figures 2 through 9* These profiles each represent a concise 
answer to Research Question 3* In Figures 2 through 7 ? the positions of 
the vocational program means (centroids) on the first two factors have been 
plotted as single points. In Figures 8 and 9, the distribution of one of 
the groups is shown by an ellipse enclosing the scores of about 50% of 
the group members. Similar, but not identical, ellipses could have been 
plotted to each of the other groups. However, one ellipse per profile 
should be sufficient to provide perspective on the amount of group dif- 
ferentiation achieved. 

Figure 2 will be used as an example of how similarity score profiles 
can provide information relevant to Research Question 3. Note that the 
first factor dimension is characterized by academic- and clerical-related 
aptitudes versus mechanical reasoning aptitude. Program differentiation 
on this factor is evident from the distribution of the groups along the 
’..standard score scale. For example, the data processing and account clerk 
‘students (area H) score toward the academic-clerical end of the dimension, 
and as one would also expect, auto-Ag. mechanics, welding, and auto body 
students (areas El and D) score toward the mechanical end. The second 
factor appears to represent a mechanical-technical dimension with 
radio-TV repair, electronics, and machine trades students (areas C and B2) 
obtaining the highest scores on the factor. Horticulture and distributive 
education students (areas E and F) score toward the other end of the 
dimension, as one would expect. More than one and one-half standard 
deviations separate the extreme groups on both factors. Thus 1 , the major 
aptitude dimensions differentiating students enrolled in the nine voca- 
tional programs represented by the M-MF analysis group appear to be an 
academic-clerical versus mechanical reasoning dimension and a mechanical- 
technical dimension. Similar analysis procedures can be applied to the 
other profiles. 




Table 5 



Aptitude Variable Correlations with 
First Two Factors 



Variable 


M-MF analysis group 


F-MF analys 


: i 3 group 


Factor 1 


Factor 2 


Factor 1 


Factor 2 


MR 


-.42 


-T 

00 


-.28 


.87 


V 


.48 


.33 


.51 


.36 


N 


. « l| 9 


.35 


.59 


• 29 


S 


.03 


• 59 


-.01 


. 50- 


P 


.31 


.17 


.39 


\ 

-.02 \ 


Q, 


.52 


• 19 


• 56 


-.11 


K 


.25 


.04 


• 53 


-.12 


F 


.25 


-.09 


.4i 


-.16 


M 


.00 


.19 


.29 


.04 


PRE-GPA 


.67 


.41 


.77 


CO 


VIQ, 


.58 


.46 


.46 


.57 


NVIQ, 


.32 


.57 


.26 


.70 
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Table 6 

Interest Variable Correlations with 
First Two Factors 



Variable; 


M-MF analysis group 


F-MF analysis group 


Factor 1 


Factor 2 


Factor 1 


Factor 2 


0-1 


.63 


.33 


.28 


.13 


M-I 


.72 


1 

o 

VO 


O- 

CM 


.13 


C-I 


-.50 


-.54 


-.48 


-.01 


S-I 


.11 


0 

1 


H 

O 


.10 


P-I 


-..28 


-.12 


o 

• 

1 


-.27 


A-I 


-.17 


-=t 

co 


.33 


.77 


L-I 


-.15 


o 

oo 


.01 


• 

o 

-0 


MU -I 


.04 


i 

• 

o 

oo 


H 

O 

• 


.26 


SS-I 


.07 


-.01 


.45 


-.59 


CL-I 


-.67 


CM 

9 

1 


-.93 


-.12 




\ 

\ 
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Table 7 





Personality Variable Correlations 
First Two Factors 


with 






M-MF analys is group 


F-MF analysis group 


Variable 


Factor 1 Factor 2 


Factor 1 Factor 2 



A-P 


-.13 


-.21 


.33 


.13 


B-P 


.54 


.15 


.71 


.25 


C-P 


-.16 


-.05 


.09 


.23 


B-P 


-.07 


O 

• 

I 


-.29 


-.26 


E-P 


-.28 


-.12 


-.09 


-.13 


F-P 


-.21 


.13 


.21 


.48 


G-P 


.32 


-.02 


.38 


.06 


H-P 


-.17 


.45 


-.01 


.48 


I-P 


-.01 


.29 


.05 


.16 


J«P 


-.26 


.58 


-.28 


.43 


0-P 


.11 


-.03 


-.16 


-.19 


Q2-P 


-.60 


-.10 


-.47 


.15 


Q3-P 


.15 


-.01 


.14 


-.01 


Q4-P 


.05 


.13 


-.14 


CO 

o 

• 
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Table 8 

Correlations of Aptitude and Interest Variables Used 
in Final Analyses with First Two Factors 







M-MF analysis group 


F-MF analysis group 


Variable 


Factor 1 Factor 2 


Factor 1 Factor 2 



MR 


.35 


CO 

LPv 


-.02 


.86 


N 






.64 


.04 


S 


.01 


.25 


.07 


.40 


Q, 


-.^5 


.11 


.38 


-.32 


PRE-GPA 


-.55 


.27 


• 79 


.09 


0-1 


.50 


-.22 


-.24 


.04 


M-I 


.54 


• 36 






C-I 


-.51 


.35 


.37 


.18 


S-I 


.02 


.43 






A-I 


.06 


-•5 8 


-.28 


.44 


SS-I 






-.24 


-.49 


CL-I 


-.63 


.17 


.70 


.08 



Note. — A vacant cell indicates that the associated variable 
was not used with the analysis group. 





Figure 2 



Distribution of M-MF Analysis Groups 
on First Two Aptitude Factors 
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Note . — *-** = r>.69; « = r of .60-.69; * = r of .50-. 59; no * = r of 
.1*0-. 1*9. Variables having factor loadings with an absolute value of less 
than Ao are not listed as factor anchors. 
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Figure 3 

Distribution of F-MF Analysis Groups 
on First Two Aptitude Factor? 
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.40-.49. Variables having factor loadings with an absolute value of less 
than .40 are not listed as factor anchors. j: 
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Figure 1; 

Distribution of M-MF Analysis Groups 
on First Two Interest Factors 
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Figure 5 

Distribution of F-MF Analysis Groups 
on First Two Interest Factors 
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.40-. 49. Variables having factor loadings with an absolute value of less 
than .40 are not listed as factor anchors. 
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Figure 6 

Distribution of M-MF Analysis Groups 
on First Two Personality Factors 
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Figure 7 

Distribution of F-MF Analysis Groups 
on First Two Personality Factors 
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Figure 8 

Similarity Score Profiles for Male and Mixed Groups 
(with Sample Scores Plotted for a Fictitious Counselee) 
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This chart can be used to plot ii student's factor scores in order to facilitate interpretation of the similarity scores given on the "Student Similarity 
Report..." The aptitude and interest dimensions represented by thv? factors are labeled at the ends of the factor scales. When ellipses are shown, they 
enclose about SO':;, of the factor scores of students falling in each r.^the indicated vocational areas. Correlation between variables and factors is indicated 
as follows *- • 
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Figure 9 



75-* Similarity Score Profiles for Female and Mixed Groups 
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Question U 



Regression analyses using the aptitude measures as predictors and 
vocational program GPA as the criterion of success were run for each of 
the 12 program groups. In these analyses, the GATE intelligence score 
(g) was added to the original predictors. 

Zero-order correlations between the predictors and the criterion are 
given in Table 9. In answer to Research Question 4, PRE-GPA is, with 
only one exception, the best single predictor across the vocational pro- 
gram areas. The one exception involves VIQ, and the vocational horticulture 
group. Depending on vocational area, a variety of other measures rank * 
second in order of effectiveness. 

Question 5 



The best two- variable combination of predictors was determined for 
each vocational program group by means of multiple regression analyses. 

(The VIQ and NVIQ measures were not included in these analyses because 
the vocational school had decided to discontinue their use.) These 
combinations, along with the multiple correlation coefficients that were 
obtained, are shown in Table 10. The results for other combinations of 
predictors are also shown for sake of perspective. There is substantial 
evidence of differential predictability in the aptitude measures accompany- 
ing PRE-GPA in the two-variable combinations. In most cases, the measures 
involved make good sense. Very little predictive ability appears to be 
lost by using the best combination of two predictors rather than the 
best three . 



In order to judge whether practical application of the best two- 
variable combination of predictors is warranted, two criteria were applied. 
First, each predictor in the best two-variable combination for a given 
vocational program group had to make a statistically significant contri- 
bution (]D<. 05) to the level of correlation achieved. This was judged by 
one-tailed t- tests on the Beta weights obtained for the variables. Two 
groups--carpentry, and auto body and welding- -failed to achieve this 
criterion. The second criterion involved the amount of increase in 
correlation obtained through use of those variables meeting the first 
criterion. This increase had to be large enough to warrant use of both 
predictors rather than just the single best predictor. All predictor 
combinations meeting the first criterion were judged to have met the 
second. Thus, in answer to Research Question 5, practical application 
of two-variable predictor combinations is warranted in 10 of the 12 
vocational program groups. Since application of the second criterion is 
purely a matter of judgment, the reader is urged to compare the correla- 
tions presented in Tables 9 and 10. 

Data-information conversion 



The results described above provide the potential Penta-County 
student with little help in the exploration of vocational program choice. 
The real pay-off of the statistical analyses does not come \mtil the 
results are used to convert student data into counseling information. 
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' Table 9 

Correlations Between Aptitude Variables 
and Vocational Course GPA 













General Aptitude 


Test Battery 




Vocational area 


VIQ, 


NV- 

IQ 


MR 


G 


V 


N 


s 


p 


Q, 


K 


F 


M 


PRE- 

GPA 


A. Carpentry 


05 


-03 


05 


21 


18 


25 


-01 


-04 


22 


07 


09 


19 


30 


B. Auto & Ag. Mech.;, 
machine trades 


19 


17 


27 


19 


07 


19 


25 


15 


09 


07 


05 


06 


37 


C. Radio & TV repair, 
electronics 


05 


04 


04 


01 


04 


08 


03 


26 


21 


20 


29 


23 


33 


D. • Auto body, welding 


11 


06 


l6 


-02 


-06 


00 


06 


-08 


00 


-08 


-03 


05 


38 


E. Horticulture 


60 


l6 


-22 


17 


18 


22 


-07 


26 


17 


29 


33 


42 


55 


F. Distributive Educ. 


04 


27 


-04 


08 


09 


15 


01 


21 


26 


18 


10 


03 


38 


G. Commercial art, 
printing, drafting 


25 


25 


07 


30 


17 


21 


21 


29 


30 


13 


01 


07 


56 


H. Data processing, 
account clerk 


32 


41 


20 


48 


34 


39 


19 


16 


21 


04 


-01 


04 


52 


I. Child care. Comm. & 
home Serv., dietary 
aid 


28 


30 


24 


28 


21 


19 


27 


18 


07 


-01 


30 


19 


42 


J. Cosmetology, dental 
assistant 


24 


21 


-02 


22 


14 


30 


10 


15 


16 


-01 


22 


08 


47 


K. Co-op. office Educ., 
office machines 


38 


26 


29 


49 


54 


39 


20 


22 


24 


30 


18 


22 


56 


L. High skill steno 


50 


44 


11 


43 


35 


4l 


14 


13 


10 


12 


-07 


12 


70 



Note. — Decimals have been omitted from all correlation coefficients in 
order to conserve space. 
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Table 10 

Multiple Correlations Between Aptitude Variables 
and Vocational Course GPA 



Two -variable combinations 3 

Best three -.variable 



Vocational area 


Best 


Pnd 


3rd 


combination 1 


A. 


Carpentry 


M( .36) 


Q(.34) 


N( .33) 


Q&M( .38) 


B. 


Auto & Ag. Mech. , 
machine trades 


mr( .44) 


S(.42) 


P(.38) 


MR&V( .46) 


C. 


Radio & TV repair, 
electronics 


F(.4l) 


M(.4o) 


P( .38) 


G&F( .45) 


D. 


Auto body, welding 


mr(.4o) 


v(.4o) 


P(.39) 


MR&V( .43) 


E. 


Horticulture 


M (.60) 


mr( .58) 


F (.58) 


MR&M( .64) 


F. 


Distributive Educ . 


Q(.45) 


p(.42) 


K(.4o) 


Q&F( .45) 


G. 


Commercial art, 
print ing , draft ing 


P(.58) 


Q.( .58) 


M( .56) 


P&0,( .58) 


H. 


Data processing, 
account clerk 


G(.58) 


v( . 56) 


Q(-5?) 


G&0,( . 59) 


I. 


Child care, Comm, & 
home Serv., dietary 
aid 


P(.47) 


s( .45) 


P( .45) 


K&F( .48) 


J. 


C os metology , dental 
ass is tent 


P(.50) 


N( .49) 


Q.( .48) . 


N&F( .51) 


K. 


Co-op. office Educ., 
office machines 


V( .65) 


G(.63) 


K( .61) 


v&m( .67) 


L. 


High skill steno 


G(.73) 


v( .72) 


N(,72) 


G&S( .74) 



Note. --The multiple correlation coefficient appears in parentheses 
after the variable label. 



a In each case, PRE-GPA was one of the variables. 
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In the case of success estimates, this is readily accomplished via 
experience tables. 

Results of the regression analyses conducted to answer Research 
Questions 4 and 5 were used to select the variables for which single- 
and double-entry experience tables were constructed. These tables are 
presented in Appendix in the form in which they were provided to the 
counselors during field tests. For most vocational program groups, 

PRE-GPA was by far the best predictor. Hence, all single-entry experience 
tables are based on this variable. The tables cover each of the 12 program 
groups even though the correlation fur a given 3 roup sometimes indicated 
a negligible relationship. It seems desirable to proyide the counselor 
and counselee with this information along with the tables for groups in 
which the relationship was substantial. However, double-entry tables 
were constructed for only those program groups in which a positive answer 
was obtained for Research Question 5.‘ 

Score categories in the experience tables were formed in such a 
manner as to divide the total, number of students in a vocational program 
group into,. halves, thirds, or fourths — the number of categories depending 
on the number of students in the group. It was not always possible to set 
up intervals that included exactly 25$, 33 l/3$, etc., of the students in 
a group because tied scores at the category boundaries would have required 
allocating students with the same score to different categories. 

Similarity scores, the second data- information conversion procedure 
used in the project, were based on the combination of ten aptitude and 
interest variables involved in the final discriminant analyses. Through 
application of centour score equations obtained from the M-MF and F-MF 
analysis grour separate sets of similarity scores were developed for 
boys and girls. Each set contained scores for the eight areas appropriate 
to the student's sex. FORTRAN language computer programs, written as part 
of the project, were used to place the scores from the antecedent variables 
into a disk file established for each prospective Penta-County applicant. 
Commercially-available reports in the form of punched cards were .obtained 
for all measures except the Lorge-Thorndike and the DAT -MR , which were 
scored locally. No similarity scores were generated for students having 
scores out of range or a Kuder verification score of less than 33* 

A modification of the classification program written by Cooley and 
Lohnes (1962) was used to calculate the similarity scores. Reports were 
in the form of a computer-printed label pasted on a pre-printed interpre- 
tation sheet. A manual was prepared to assist counselors in the use of 
the reports. Important sections of this manual, including a "Student 
Similarity Report," for our fictitious friend, Fred Cartesian, are 
reproduced in Appendix B. 

Similarity score labels and pre-printed interpretation sheets were 
sent to feeder school counselors as soon as all test score reports had 
been received and processed at an operations center established at the 
University of Toledo. Transfer of center responsibilities and computer 
programs to the Penta-County Vocational School is scheduled for completion 
by September, 1970. The vocational school district will c.ontinue project 
activities through use of its own funds and computer facilities. 




2 Examples attached. 
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Field tests 

Initial field-testing of project data- information conversion pro- 
cedures involved l60 sophomores enrolled in four feeder high schools 
during the 1968-69 school year. The counselors in these schools volunteered 
to use project reports with students considering application for entrance 
into Penta-County in the fall of 1969. The reports were based on prelimi- 
nary analyses conducted in the summer of 1968 with data available from i960 
and 1967 entrants. Students in the analysis ' groups had a GPA of n D n or 
better in vocational course work and had not dropped out of school. 

Two types of reports were provided to the counselors--local stanine norms 
for the aptitude variables and a preliminary version of the similarity 
score report illustrated in Appendix B . 3 The stanine norms were calculated 
separately for programs enrolling primarily males, primarily females, both 
males and females, and for the total sample. In order to provide perspec- 
tive on the level of aptitude represented by the Penta-County student body, 
the total sample norms are presented as Table 19 in Appendix I). 

Counselor reactions to use of the project reports can be summarized 
as follows : 

1 . The similarity scores were much more, helpful than the 
local norms in counseling prospective Penta-County students. 

2 . The similarity scores were sometimes difficult to interpret, 
especially when a student f s scores were all low or when a student 
questioned why his scores came out as they did. 

3 . Testing had to be completed earlier in the school year if there 
was to be adequate time for use of similarity scores in facilitating 
exploration of vocational program options . \ 

As a result of these reactions, development of local stanine norms 
was discontinued; similarity score profiles were developed to facilitate 
similarity score interpretation; and feeder schools were urged to test 
potential Penta-County applicants late in the spring or early in the fall 
of the year preceding the late winter application deadline. 

Field testing during the 1969-70 school year involved approximately 
900 students enrolled in 12 of the l 4 feeder high schools. All were 
potential Penta-County enrollees. The median number of students per 
school was &5 with the range being 30 to 185. Administration of all 
tests was completed by late fall, with five schools electing to test 
during the preceding spring. 

In addition to the commercially-available test score reports, 
counselors received a set of experience tables, similarity score reports 
for each of their potential enrollees, similarity score profiles, and the 
interpretive manual mentioned previously. A half-day workshop was held 
to introduce counselors to project reports and data-information conversion 
procedures. Each school was visited at least once, and in several 
instances the project director observed or participated in the interpre- 
tation of similarity score reports and profiles. 
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Counselor reaction to the data- information conversion procedures used 
during the 19o9-?0 school year was sought both informally and via the 
11- item survey sheet reproduced with a summary of counselor reactions in 
Appendix C.^ A meeting was held with the counselors in order to provide 
an opportunity for them to elaborate on their survey reactions. Audio- 
tape copies of the discussion during this meeting are available upon request. 

Overall counselor reaction to the reporting procedures was quite 
encouraging. Suggestions for improvement chiefly involved modifications 
of the similarity score profiles to facilitate their introduction to 
students. As a result, a three-step procedure for profile introduction 
was developed for field tests during the 1970-71 school year. This pro- 
cedure involves a series of three similarity score profiles conveying 
progressively more detailed information on the "why 11 ; of a student's simi- 
larity scores. Counselors can use all three profiles with some students, 
or just one of them — depending on student readiness and need. The first 
profile shows the positions of the various vocational programs as coordinate 
points on two factors. The second profile contains, ? in addition, an ellipse 
enclosing the factor scores of about 5 0 % of the students in one of the 
vocational areas as illustrated by Figure 8. The third profile has ellipses 
for all of the vocational programs. Examples of the;- first two profiles 
are presented in Appendix E. 

j| 

An informal survey of student reaction to reporting procedures was 
also completed after the 1969-70 field tests. Ninel! of the 12 schools 
agreed to identify a "reasonably representative” sample of students who 
had received the reports. Various suggestions for (|oing this short of 
using a random number table were given. The median!; number of students 
surveyed per school was 10 with the range being 5 t$ 43. Student reactions 
to reporting procedures are summarized on the survey sheet reproduced in 
Appendix C.4 It is encouraging to note that few students viewed the simi- 
larity scores as telling them what to do (item 3)? |ind that only 8 % felt 
that the similarity scores were of no help in thinking about vocational 
program options (item 2). Student comments on the reporting procedures 
are especially refreshing. Who could feel disappointed by a test inter- 
pretation that " . . .told a little more about rne th^t I didn't quite know" ! 

Student and counselor reactions will again be sought during 1970-71 ; 
field testing. In addition, cross-validation analyses of vocational 
program membership predictions based on similarity scores are planned. 

It will also be possible to compare the satisfaction ratings of students 
who did not enter programs to which they were similar with the ratings of 
those who did. Finally, project reports will be provided to one randomly- 
selected group of potential enrollees but withheld from another. The 
normal, commercially-available test score reports will be available for 
use in .counseling members of both groups. When follow-up data become 
available, success and satisfaction comparisons wi.pl be conducted for 
the experimental and control groups. 

Secondary objective 

The secondary objective of this project was to develop and field- 
test a prototype package of computer programs designed to facilitate 
data- information conversion. The computer-based procedures that were 




4 



Attached . 



33 



34 



developed and implemented as part of this project have already been 
described. Interpretive reports prepared for counselors and counselees 
have been illustrated. The development of one of these reports — similarity 
score prof iles — represents an unexpected project outcome. 

Counselor and student response to field tests of project data- information 
conversion procedures resulted in the decision by the host vocational school 
district to continue project activities through use of its own funds and 
computer facilities. In addition, support was obtained from the Ohio Board 
of Regents to generalize the prototype package of computer programs that 
was developed. It would seem clear, on the basis of the above evidence, 
that the secondary objective of the project has been accomplished. 
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Discussion 



In this study, aptitude and interest measures were found to be 
substantially more effective than the personality measures in differenti- 
ating students enrolled in the various vocational programs. Although this 
finding is in general agreement with the results of research reported by 
Keim (1967)3 Pucel and Nelson (1969)3 and Stewart (1966, 1968), it must 
be viewed with caution because of possible criterion contamination by the 
aptitude and interest measures. Ideally, all test score reports would 
have been withheld from counselors until after the validation analyses 
were completed. However, this was not possible from a practical standpoint 
i.e., the study could never have begun. Instead, the commercially- 
available score reports for all measures except HSPO, and VIQ, were provided 
to feeder school counselors with no direction as to how they should be 
used. If there were uniform biases in the interpretation of the score 
reports across the feeder schools, it is possible that these biases would 
be reflected in choice of vocational program by prospective Penta-County 
students. However, the success and satisfaction criteria that were used 
in the study should have reduced the effect of any criterion group 
contamination resulting from test interpretation. One would expect that 
students who had made poor program choices as a result of test interpre- 
tation biases would have been excluded from the analysis groups by these 
criteria . 

Even if all of the test score reports could have been withheld, 
Penta-County enrollees would not have randomly assigned themselves to 
vocational programs. Other antecedent data would still have had an 
influence on their decisions. One can only hope that counselors will 
help students to view data--from whatever source--in proper perspective. 

Empirical evidence on the possibility of criterion group contamination 
was obtained from analyses run on vocational program enrollees who did not 
meet the success and satisfaction criteria and, hence, were excluded from 
the analysis groups. One might reasonably expect differences between the 
factor scores of these "nonmembers" and their successful and satisfied 
counterparts. Figures 10 and 11 show the nature of these differences 
for the aptitude and interest variables combined. The factor positions 
of both members and nonmembers are based on equations obtained from the 
final, analyses performed on members. The position of the nonmembers in 
relation to the members of each program group is indicated by an arrow 
pointing toward the nonmember group. Since several of the nonmember 
groups are rather small (as can be determined from Table l), the results 
for those particular groups must be viewed with considerable caution. 

In most cases, the member- nonmember differences appear to be plausible 
For example, Figure 10 shows that the radio-TV repair and electronics 
nonmembers (area C) score further toward the artistic interest end of the 
second factor than their counterparts. The nonmembers also appear to be 
somewhat less able, as indicated by their position on the first factor. 
Likewise, Figure 11 shows that cooperative office education and office 
machines nonmembers (area K) score substantially lower than members on 
the clerical dimension represented by the first factor. 
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Distribution of M-MF Member-Nomuember Analysis Groups 



on First IV o Aptitude-Interest Factors 




Note.--*** - r y .695 ** - r of .6O-.695 * = r of .50-.59S no * = r of 
.UO-.U9. Variables having factor loadings with an absolute value of less 
than .40 are not listed as factor anchors. 

Arrows point from member to nonmember groups. 
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Figure 11 

Distribution of F-MF Member-Nonmember Analysis Groups 
on First Two Aptitude-Interest Factors 
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Separate multivariate analyses of variance were also conducted for 
the M-MF and F-MF nonmember students. The differentiation achieved by 
the combined set of aptitude and interest measures was substantially less 
for nonmembers than for their successful and satisfied counterparts. 

Wilks 1 lambda failed to achieve significance at the .05 level for the 
HSPQ analyses. Thus, in accordance with results reported by D’Costa (1968), 

. application of group membership criteria substantially improved the amount 
of group differentiation that was achieved. Figures 10 and 11 suggest that 
the improvement might be due, at least in part, to the elimination of 
students who had made inappropriate choices in terms of their aptitudes 
and interests. This would serve to reduce any criterion group contamination 
by the aptitude and interest measures. 

The fact remains that the HSPQ results were not available to counselors 
while the results from the aptitude and interest measures were. The large 
differences in group differentiation obtained for the two sets of variables 
might be explained on this basis although it seems highly unlikely. 

The effectiveness of PRE-GPA as a predictor of vocational course grades 
was not unexpected. This finding is in agreement with results reported for 
vocational-technical programs at the community college level (Baird, 19 & 9 ? 
Lunneborg & Lunneborg, 1969). Whether vocational programs grades should 
be related to prior academic grades is a matter of debate. Certainly, one 
would hope that prior GPA in academic courses would not be the only effec- 
tive predictor of vocational course GPA. This study did produce evidence 
of differential validity among the other predictors that were used. 

The data- information conversion procedures developed and implemented 
in this project can only aid, not replace, educational-vocational guidance 
and counseling. As a result of employing these procedures, one obtains 
informat ion-~nothing more, nothing less. Although this information can 
vary in accuracy and usefulness, it can make no decisions. Neither can 
it substitute for the day-to-day vocational development that students 
experience in an ongoing guidance program. Information is a necessary 
but not sufficient condition for good decision making (Clarke, Gelatt, & 
Levine, 1965). 
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SELECTED APPENDICES 



The appendices or sections of appendices listed below are included 
with this paper for ready reference. Appendices not appearing here can 
be found in the USOE research report by Prediger (1970) cited in the 
reference list. 



APPENDIX A:: TVIFS — Test Validation and Information Feedback System 

APPENDIX B: Only two items are included — 

1. Most recent revision of student report form entitled 
"Exploring Penta-County Vocational Programs" 

2. Examples of single- and double-entry experience tables 

APPENDIX €: Surveys of counselor and student reactions to field tests — 

1. "Summary of Reactions," i.e., counselor reactions to 
field tests 

2. "Student Survey Summary," i.e., student reactions to 
field tests 
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APPENDIX A 
Abstract 

TVIFS--Test Validation and Information Feedback System 
(A Computer-based Guidance Support System) 



Objectives of system * TV IP’S is a computer-based guidance support 
system that does not requi.re student -computer interaction. The major 
purpose of the system is to transform test scores and other data into 
validated information readily useable in a counseling setting. Inter- 
pretive reports specific to individual counselees can be provided for 
many common guidance uses of test results. Through TVIFS, the counselor 
is relieved of much of the burden of data collection (including follow- 
up) and statistical analysis (i.ncluding the extraction of useful infor- 
mation from analyses). 

Description. TVIFS is a disk-oriented, modular system written in 
the FORTRAN programming language. Its three major functions are as 
follows : 

1. Data collection, computer input, and random access storage. 

2. Validat ion analysis by means of multiple discriminant analysis 
and regression packages. 

3- Use of validation analysis results (when warranted) to generate 
the following types of feedback: (a) one- and two-way experience tables 

showing the relationship of test scores to criteria such as grades in 
specific courses or programs, persistence-dropout status, job satisfac- 
tion, etc.; (b) scores showing the similarity of a counselee's test 
results to the results of students in various criterion groups, e.g., 
academic programs, vocational programs, occupations, colleges; (c) sim- 
ilarity score profiles showing the performance of different criterion 
groups on the major discriminant factors represented in the test scores 
and/or other predictive data. 

No restrictions have been placed on the tests that can be used. 

Other predictive data could include course grades, scaled ratings, atten- 
dance record, etc. Through use of correspondence tables, school or col- 
lege progress data are accessible to TVIFS via the punched card or mag- 
netic tape output normally developed by institutions having data process- 
ing equipment. Special data collection forms can be used by other insti- 
tutions. Student follow-up, including selection of follow-up sample, 
printing of mailing labels, and tabulation of results, is performed by 
computer. Results of the follow-up become part of the data base and can 
be used in the validation analyses. 

Current status . A prototype model of TVIFS was field tested during 
1968-69 and 1Q69"70 academic years in 12 high schools associated with a 
vocational school district. Counselor and student reactions to inter- 
pretive reports were used to revise the portotype system and to develop 
specifications for TVIFS. With the exception of the post-high school and 
post-college follow-up components, TVIFS is scheduled to become operational 
in 1971. Examples of interpretive reports and summaries of counselor and 
student reaction to previous field tests will be provided upon request. 
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APPENDIX B 

EXPLORING PENTA-COUNTY VOCATIONAL PROGRAMS 

If you are thinking about going to Penta-County, you probably face a difficult decision-the choice of which 
vocational program you wish to enter. This report won't tell you what to do. But it will provide some information 
that can help you explore what Penta-County has to offer. The vocational programs ?t Penta have been grouped 
into the 12 areas listed to the left of the box below. Your counselor will give you a label that fits over the box. This 
label contains, scores giving a rough estimate of your similarity to students in the different programs. These 
“similarity scores" are based on aptitude and interest tests you have taken in the last year. 



THE KEY POINT IS THIS: The higher your score for an area, the more similar you are to students in that 
vocational area. The highest score you can get is 100. The lowest score is zero. A zero score for area E would mean 
that your test scores do not look like the scores made by students in vocational horticulture. It's still O.K. to 
consider horticulture, however. Test results, after all, don't give the whole picture. You must consider them along 
with all the other things you know about yourself and Penta-County programs. 



THE BEST WAY TO USE THIS REPORT is to find the vocational programs in which you score the highest. These 
are programs you might want to explore-find out more about. Perhaps you would not have thought of them 
otherwise. You certainly don't want to overlook a good possibility. There's too much at stake. 



VOCATIONAL AREAS 

Mostly boys enroll 
\ A. Carpentry 

B. Auto & Ag. Mechanics, 
Machine Trades 

C. Radio & TV, Electronics 

D. Auto Body, Welding 

Both boys & girls enroll 
V E. Vocational Horticulture 

F. Distributive Education 
^ G. Commercial Art, 

Printing, Drafting 

H. Data Processing, 

Account Clerk 

Mostly girls enroll 

I. Child Care Aide or 
Ass't., Community & 
Home Service, 

Dietary Aide 

J. Cosmetology, Dental 
Assistant 

K. Co-op Office Education, 
Office Machines 

L. High Skill Steno 



SAMPLE LABEL 

X 

032154 FRED E CARTESIAN 10/14/69 

STUDENT SIMILARITY SCORES FOR P-C VOC. PROGRAMS 

AREA= ABCDEFGHIJKL 

SC0RES= 41 14 03 26 87 25 28 01 

RANK= a— / 3 

AREA= ABCDEFGHIJKL 



PROFILE FACTOR SCORES: 56, 36 

/ 



SO HOW DO YOU USE THE SCORES ON YOUR LABEL? 

First, peste your label on the box shown above. Next, find and rank your top 3 or 4 
scores. Give the highest score a rank of 1, etc., and write the ranks on the line beiow 
your scores. Finally, put a check mark beside the names of the 3 or 4 areas ranking 
the highest. These are the areas that your test results suggest you might want to find 
out more about. Some students receive low scores in all of the areas. This simply 
means that the test results aren't of much help in suggesting areas to explore. 
Whether your scores are "high" or "low," your counselor can help you figure out 
why they came out the way they did. 



*n order to judge how successful you might be in a program, you must also consider if you have the course work, 
aptitudes, and personal desire that is needed. This report doesnof tell you that. However, with the help of your 
counselor and your parents, you can use it along with other information as you explore the programs available at 
Penta-County. 
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APPENDIX B 

SINGLE ENTRY EXPERIENCE TABLES (9/69) 



Students in each of the groups listed below entered Penta,-County in September 
of 1966 ^ 19o7 * and 1968 . The Penta-County vocational area grade point average (GPA) 
is based on vocational course work, (related and shop or lab) completed up to (a) time 
of graduation (Fall ’66 and r 6 ? entrants); (b) end of junior year (Fall '68 entrants); 
or (c) dropout.. For each predictor category (row) in the table, the percent of 
students whose grades at Penta-County fell into each of the PO£PA categories (columns) 
is shown, 

A = 40, B = 30, C = 30, D = 10, and F = 00. 





DOUBLE ENTRY EXPERIENCE TABLES (9/69) 



f 

< 



o 

ERIC 



w 

^ p 
CD C 
VO O 
OV 03 

H q 
-P 
03 CO 

C 

d 0) 

W 

* O - 
t— ft 
VO ft 
Q\ 

H ft 

O 

•> 

vO -P 1 
vO C 
Q\ d) 
H O 

, ft 
ft 0) 
o ft 

ft d) 
d) ft 
ft ft 



O 

W S 
P 
w C 

* H B 

^ o 

O I 

ctf 

II ft 

o § 

0J Oh 

<D 

ft 

P 

0 ) . ' 
ft i— I 
H 
ft 0) 

o a 



d oo 

H VO 

ft ~ 

O H 
rH 
ft d 
o 

ft 1 — • 
co 

ft 

03 d 



03 ft 
O O 
P *H 
d 0 
H 0 
0) 
ft 

^ Cm 
O 
ft 

ft 03 

o c 
£ 0) 



o o 
o £ 



p 

c o 

a) 

ft w 



ft 
a; 
>> £ 



aj co 
p 

C ft 
dJ o 

o3 co 



<u 

p 

to 



•H P 
H d 
C 

co .h 

fr-9 
S S 
o o 

ft o 
tn 

w 



dJ 

ft 

p 

ft 

O 



ctf O 
P 
03 

<D o3 
ft dJ 
•H CO 
d ft 
p 

p co 
O vH 



ft P 

o a 

d d) 
d) co 
d) 



a 

•H 

(0 

P 

ft 

d) 

o3 

0 

P 

CO 



d) 

o 

<D 
i— I 
ft 
d 
H 



ft w 

^.H 
i — I <D 

P P 
OJ CO 

o d 

ft ft 
a; < 
> 

•H 

tiO • 
rH 
d rH 
<1) 

ft O 
•H 

txO *S 

d 
d) 



p ft 
d d) 

o 

o t>~ 
> VO 

c ~ 

O 03 

c 

o3 d 

d) 

w vO 
d vO 
ft - 

co i — I 

• H ^ 
^ ft 

ft . 
O ft 
^ O 

•rH 
d) p 

SP S' 

ft 03 

d) d 

£ * 
d bO 

P ft 
ft O 
• H 
O 
ft 



ft 

0 

ft 

d) 

ft 






w 

p 

c 
( u 
03 
ft 
P 
co 

d) 

co 

d) 

ft 

p 

ft 

o 

ft 

dJ 

p 



ft ft 



d) 




i — 1 


d 






d) 


p 


• 


CM 




d) 


— >. 


> d) 


ft 


CO 




0 


CO 


P 


•h ,a 


d) 


ft 


•rH 


ft 


' — ■ 


hO P 


CO 


0 


0 




a 




^ ii 




p 




CO 


o 


• •> 


c 


o < 


0) 


O 


y 


ft 






ft 


CO 




CO 


*0) 




o3 


o 


d 


rH 


p 


ft 




d) 




O 


d 


C! 


p 


P 


ft 


1 — 1 




C 


d 


•H • 


q 


ft 


d 


o 


0 


ft 


? o3 


3 


0 


rH 


•H 


P 


a> 



W 



P o 
d O 
O rH 
•H 

o3 X 
ft 

* n'V. 

|5 ^ 

O 

^ • 

II o 
u o 

O 

ft II 



r-H 

ft ^ 

d o 

ft ft 



<L) 

e 

• H 
d) P 
o3 

d ^ 
d 

UD*- — -- 

d o ■ 

cu p 

k 

di ft 

H P 
d o3 - 
a <D 
O P 
•H d) 
P rH 
d ft 

^ § 
o o 

> o 



a I 

d) 3 
ft H 
ft O 
d a 

w cu 
ft ft 
d p 
P 

O C 
P *H 

£ hD 
O C 
• $-1 -H 
P rH 
g 03 H 
O c d 
ft d ft 
O 

u c 

o3 S 



ft 

* 

o a 

d 

It 

r\ 

o o 

aj ft 
it 

u 

CD P 
P 
P 

d) o 

P OJ 



w 
d) 

o 

o o o 
v w 



o o 

ft 

• ft 

d 

W p 
P d 
ft P 
d 
U 
P 
ft 
d) 



11 

o 



CM ^ 

# o 
ft m 

a 

& 

d O 
P- 
bD 

ft II 
•H 

•S* 35 

d 

P 

p 

O 



O 

LA 



ft 



ft 

S 

03 

ft 

d 



w 

•H 



d 

0 
•H 

t 

01 
J> 



ss 

ft 



ft 



w 

ft 

O 

P 

o 

*H 

o3 

d) 

ft 

ft 



t- 

P- 



ft 

ft 

i 

ft 

I 

03 

a 

d 

oo 

OJ 

>H H W 
E-l II *H 
M ft X 
S d 






o 





45 



46 



APPENDIX C 

SUMMARY OF REACTIONS 
(with examples of counselor comments) 



PC District Counselor 



Janu.-ry 26, 1970 



To: Penta-Countv Disci id. Counselors 

Fro;:'.: PC-TU Project Office 

Re: Feedback on Testing Reports (URGENT!) 



There’s been alot of blood under the bridge since the PC-TU Project 
began in January, 1966; and the time has come to get your final reactions 
to our efforts- You will have a chance to share your reactions with others 
during the February 3rd P-C District Counselors Meeting. However, we need 
to get some things on paper for use in the formal project report. 

From the beginning, our goal has been to obtain validated test informa- 
tion that goes beyond the type of reports available through commercial 
publishers and scoring services. A r you know, we are riot promoting tests 
as the panacea for educational and vocational guidance. Rather, we sec 
information from tests as properly taking its place along with all of the 
other information and experiences that go into the making of wise decisions. 

The general purpose of the questions belov; is to obtain your professional 
estimate of the usefulness of the new reporting procedures provided this 
year. Please check the letter that best represents your response to each 
question. (This "multiple-choice" format is supposed to make your job 
easier!) Comments on your responses to the questions are welcome . Suggestions 
for changes in current project services or for additional services, etc. 
would also be appreciated. 

Please return this survey to Louise Fought by FRIDAY, JANUARY 30TH. 

An extra survey has been included so that other counselors in your school 
who may have used the new reports can respond. 

1. In what way were you able to make use of the Similarity Score Reports 
(blue forms)? 

a. Group Interpretation only 

9 b . Both group and individual interpretation 
d c . Individual interpretation only 

£ d . Other: Used own form :k: r quo in ter eretat ion arid blue 

f orm w ith indiv lout i . _ 
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2. Do you feel that the Similarity Score Reports (blue forms) readily 
lend themselves to group interpretation? 



3. 



9 Yes: 



COMMENTS : A . r tf 

One counse- or answerea 

individual follow-ups 

they are). He did successfully 



V, 



1 M o rer ponse- -Used own form for group 
interpretation. 

‘‘no" above because he felt that 
after general group sessions were necessary (which 
communicate general concepts in groups. 



:ow over- 



flow useful do you feel the Similarity Score Reports (blue forms) are 
in helping students consider their possibilities at Penta-County? 



_a. Very useful 
_b . Of some value 
__c. Of little value 
d. Of no value at all 



COMMENTS : 

Reports came too late. 



A. In terms of usefulness in helping students consider their possibilities 
at Penta-County , how do the Similarity Score Reports (blue forms) com- 
pare with the regular test score reports available from commercial 
publishers (Kuder profiJ.es, GATE cards, DAT -MR score lists, etc.)? 



2 a. Much more useful than the regular test score reports used alone. 

® b. Somewhat more useful than the regular score reports used alone. 

__ c. Generally add little, if anything, to the usefulness of the regular 

score reports , 

<P. Test data, in any form, is of little or no value in working with 

potential Penta-County students. 



i No response 

COMMENT*: r^ e i n f oma tion on the similarity sheet 
mation the student wants to know. The Kuder amuses 
but the similarity scores direct their thoughts for 



is really the infor- 
the GATB informs, 
specific consideration. 



5. What is your reaction to the Similarity Score Profiles ( ellipse charts) 
as a way to facilitate the counselor r s understanding of why a given 
student’s Similarity Scores came out as they did? 



O 

ERIC 



l a. The Profiles are of no value in providing insights into the 

reasons for a student's Similarity Scores. 

5 b. The Profiles are of some value. 
o c . The Profiles are quite useful. 



pn\*VTT\TC * 

8 (Counselor who checked "C" above) — Except that I would not 
let the students in general find out I could do this because I would never 
have the time to do it with everyone. 

(Counselor who checked "B” above) --Original ellipse charts 
witn all ellipses on one sheet tend to be confusing. Did not have chance 
to use single ellipse approach ^Introduced at mid-year^] . 
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6, What is' your reaction to showing the Similarity Score Profiles (ellipse 
charts)/ to students as a means of facilitating their understanding of 
why their Similarity Scores came out as they did? (Assume that the 
two-stage process suggested in Feedback Bulletin No. 2 is followed, i.e., 
student is introduced to chart having only a single ellipse before 
being presented with a chart having all eight ellipses.) 

1 a . The Profiles can be used with understanding by almost all 
potential Penta-County students. 

5 b, The Profiles can be understood by a majority of these students. 

3 c . A few students are able to understand the Profiles. However, 
most students would probably become confused. 

£ d . Current format of "Similarity Score Profiles ’ 1 is too confusing 
to permit use with any students. 

1 Other--Depends on person doing interpretation & quality of 

COMMENTS : explanation. 

Encouraged many students to take a closer look at the areas involved. 

I must honestly say I have confused students here. I am getting better. 

7. If you had ample time to use the Similarity Score Profiles (ellipse 
charts), would you use them with-- 

a. mo students at all? 

3 b . only those students with low Similarity Scores? 

h c . only those students asking questions about why their Similarity 

Scores came out as they did? 
k d . almost all students? 

1 e. Other: Need more time to think about this. 



COMMENTS: Also useful with students having high similarity scores in areas 
that surprised them. Why did they score so high? 

(Counselor who checked "D" above) — Why limit its application? 

Why allow inhibitions to keep this useful technique from some students? 

8. To what extent do you feel your students were able to put their Similarity 
Scores to good use? 

£ a. Most students appeared to make very little, if any, use of their 
Similarity Scores. 

7 b . Most students appeared to maintain proper perspective in using 
their Similarity Scores; i.e., they used them as one kind of 
information to be considered in exploring their possibilities at 
Penta-County • 

Most students appeared to place too much emphasis or reliance on 
the Similarity Scores, e.g., they let the scores make decisions 
for them, jumped to unwarranted conclusions, etc. 

_JS_d. Other: Difficult to tell • 



COMMENTS : 
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9. How useful do you feel the Experience Tables (single-entry and double- 
entry) presented in the "Manual for Interpretation of Results” were in 
helping your students think about their possibilities at Penta-County? 

? a . Very useful 

3 b. Of some value 

1 c. Of little value 
d. Of no value at all 

4 Other--not used, no time, etc. 

COMMENTS: 



10. In terms of usefulness with potential Penta-County applicants, how do 
the new reporting procedures taken as a whole , i , e . --Simi lari ty Score 
Reports, Profiles, and Experience Tables--compare with the regular test 
score reports available from commercial publishers (i.e., Kuder profiles, 
GATB cards, DAT-MR score lists, etc.)? 

7 a . Much more useful than the regular test score reports used alone. 



2 


b. 


Somewhat more 


useful than the regular 


score reports used alone. 


2 


c . 


Generally add 


little, if anything, to 


the usefulness of the regular 


i 

X 


d. 


score reports 
Test data, in 


any form, is of little 


or no value in working with 



potential Penta-County students. 

COMMENTS: (Counselor who checked "D m above) --Students seem to have their 

minds made up about wanting to attend vocational school regardless of 

their test scores. 

Needed results earlier. 

11. What modifications, changes, etc. in the reporting procedures, forms, 

''Manual for Interpretation of Results," etc., would you like to see? 

1. Separate similarity score labels for boys and girls. This would 
eliminate the zeros. 

2. Identify area on ellipse profiles, rather than using a letter code. 

3. The change made earlier (single ellipses for introduction) was a good one. 

4. Possibly changing the heading of the blue form to something about 
exploratory. Maybe the word similarity makes the student assume he 
should go into an area in which he scored high. 

5* Color coding the centour score profiles for easier reading. 

6. I think perhaps a centour - profile for each area will help, so I am 
making (attempting to make) my own. 

7- More time to use reports. 



Date 

0 

ERIC 



School 



. Counselor 
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Dear Student, 



February, 1970 



Your school counselor has been trying out a new way of reporting test results to 
students who are thinking about going to Penta-County. Examples of the new report 
forms are attached. We would like to get your reactions to these forms so that they may 
be revised and improved. Your answers to the questions below will help us find out how 
we can do things better. Please check the one response to each question that best 
expresses your reaction. 



1. Do you recall receiving a copy of the attached blue f orm with your Similarity Score 
label pasted on it? 1^4 Y es; 9 N o ; 3 I 'm not sure 

If your answer is yes , please go on to the second question. O therwise , print your 
name at the bottom of the page and wait until the others have finished. 



2. Did you find the Similarity Scores reported on your copy of the blue form to be 
helpful as you thought about programs that you might enter at Penta-County? 

13 a) They really weren't of any help to me. 

, 100 b ) They v?ere of some help. 

^t-1 c ) They helped alot. 



3. What was the main way in which the Similarity Scores were helpful to you? (Please 
check only one *’j^s ponse . Circle the letter for any other responses that you would 
also like to check.) 



Circled 


12 


a) 


10 


9 


b) 


15 


, 99 


c) 


12 


52 


d) 


22 


21 




0 


3, 


f) 



They weren't of any help. 

They told me which program I should enter. 

They suggested programs that I hadn't thought about before. As a 
result, I looked into some of these programs. 

They backed up the program choices I had already made. 

They suggested that some programs I had been thinking about might 
not be as "right" for me as some other programs. 

They told me that I shouldn't go to Penta-County. 



4, The white form attached to this sheet has some red and blue ovals on it. Did 
you discuss a fora like this with your counselor? 

$6 Y es ; 83 N o ; 15 I don't remember for sure 

If your answer is yes , please go on to the 5th question. Otherwise, go on 
to question 6. 

5. Did the white form help you understand the ways in which your interests and 
abilities were similar to or different from students in various vocational pro- 
grams at Penta-County? 

13 a ) It helped alot, 

34 b ) it gave me some help in understanding my similarities and differences. 
o c) It wasn't of much help. 

3 d ) It just got me confused. 



6. This space and the back of this sheet are for YOUR COMMENTS on the new reports. 

Was there anything special you liked about them or something that could be improved? 



See attached sheet for sampling of student responses. 



0 

ERIC 



Date 



School 



Name 
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STU1>ENT SURVEY 3uM!*L'\i-vi (continued) 



The quotations below are a sampling of the more interesting 
responses to item number 6 on the survey form. The item reads as follows: 
11 Til is space and the back of this sheet are for YOUR COMi-iEUTS on the new 
reports. Was there anything special you liked about them or something 
that could be improved??" 

1. I think it helped to make me think about what I should take. 

2. The reason they didn’t help that much is because I already had my 

mind made up and I was gonna take cosmetology no matter what because 
I know I can do this well. I think these reports are good if you 
don’t know what you want to take for sure* But otherwise if you 
know definitely what you want. I don’t think there worth it. But 
you don’t know who knows what they want. So I think its worth the 
time . 

3. I think these tests helped me in trying to decide whether to take 

the P.C. program or look into another field. I liked the w ay it 

compared me to other students in a particular program. The dis- 
cussion of these tests with the counselor helped me also. 

4. When at first I sav; my scores, it kind of dissapointed me to see 

such low scores but the circles helped explain why they were so. 

5. It surprised me alot. 

6. How many years do you have to have for Auto Body Repair man? 

7. As long as there is a counselor or someone to go over the results 

and have the students understand them, I think this type of test 
is good and beneficial. 

8. I liked it all right. But I wish they would translate the big words 
into small ones, and then 1 would probably understand it. 

9. They help me a little on one hand and on the other hand they just 
confused me, not mutch but just a little biu. 

10. I think the reports were very good. It in a way helped me make up 
my mind. Although I didn’t score the highest in the field I’m 
planning to take, the reports were excellent guides. 

11. Leave it like it is. 

12. It didn’t help. I wanted to take Cosmetology - and it showed that 

I only ranked 3rd in it. I still want to take Cosmetology, I really 
don’t want Child Care. For a second choice, yes. 

13. The results on similarity reports really helped my decision. I’ve 
changed my mind about my course completely, hopefuiy for the better. 

14. The reports told a little more about me that I didn't quite know. 
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